docohemt bssohe 



BD 103 789 

AUTHOR 
TITLE 

PUB PATE 
NOTE 



EBBS PRICE 
DESCRIPTORS 



06 009 66a 

Carlson, Robert v.; Harchant# William C. 
oudge or Jury: The Problem o£ Assessing Learning 
Environments* 
[72] 

ISp.; Not available in hardcopy due to marginal 
legibility of original document 

!1F*$0.76 HC Mot Available from EPRS*. PLUS POSTAGE 
'i^Classroom Environment; ^Educational Assessment; 
Elementary Education; Environmental Research; 
itiEvaluation; ♦Evaluation Methods; Learning 
Difficulties; Motivation; *Program Evaluation 
IDENTIFIERS ♦Student Opinion Poll 

ABSTRACT 

Elementiary school principals and guidance personnel 
are being called upon more frequently to evaluate the efficacy of 
educational goals and the means for attaining these goals. This 
article presents alternative methods to standardized testing for 
garntring significant information abcut the school environment. Three 
broad categories presented are school* vide, classroom and individual* 
TO assess school environments the authors recommend using the Student 
Opinion Poll, a 49<-item questionnaire. A number of other tools are 
also discussed. Two approaches mentioned to assess the classroom 
environment are a questionnaire approach and an interaction analysis 
approach. The third level of the assessment process, focusing on 
specific individual pupil behavior, necessitates the identification 
of specific assessment devices. This process should provide a better 
understanding of the nature of the students' and/or teacher's 
problem. The motivation behind student behavior mu^t be more clearly 
understood, and the assessment tools presented in this report can 
give some direction to this search. (Author/BW) 
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S Blementary 0chooX principals and guidance personnel ^^^^ 

2 inore and more often being called upon to play the role of judge f 
^ and Jury relative to providing a formaliaed approach to evalu- 
ating the efficacy of educational goaXa and/or the meana for ]; 
attaining the^e goaXe. It is apparent that school personnel n«»ed 
to have at their disposai various devices with whHich they can 
garner significant information about varrlables which impinge 
upon a child's adjustment to the sc&aol setting ^d the school*©, 
need to adapt to individual differences* 

too often our response to classroom assessment needs is 
limited to standardized aehievtjment and ability tests. The pur- 
pose of this article la to present alternative kefchods of garii«jrln 
significant Information about the school environment, ' 'Td'' 

Assessment procedures can be applied to tlA© total sohool^^ 
environment, to the classroom, or focused upoa the individual , 
Child* Thus, we present three bro€ eateg6ri«*8t «ch6ol*^wide, / 
classroom, and individual* In each case whether the broad eontekt 
is being viewed or performance of a child, the main sourcci of 
information is the child and his/hei^ perceptiona of the learning 

environment* •. ' 

the three categories previously noted suggests a sequence 
for assessing school difficultiesj}j^> depending on ons's personal; 
biasi . it is possible that ,many ttei^ktive attitiiAes and beha.vioj?s 
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my eitom ftm t3).c ov«r-aXJ. school envlx'onmairt ov fvom m iMivicS- 
ml attributes of chia.<l. Xt 8u<>«i3 f«sae.iW.« to Wi^m "cUt by 
^mmyi^fi imny of tho ni&e,ativ.ft aspects of thf* totaX ^n^ivommt 
th© msaHiw of remaining personaX adjustnitsnt prpbXenisi would 
P'»eatXy x^«3duc©^. Thus, a aqhooX-widcx assessment pvo^vam wouXd 
bcs a x«oa<5onable approach. However', it also possible to argnn 
foi? initiating the a^seaement process with the incUvidual since 
it ie pi;>obahXe that more change can be facilitated through «>n 
ijidivicJual than with the total school.* Th?5 assecisxiient d«.vice3 
©j^plored in this article combine these two concepts by ©u>?veyl»g 
pupils individually via questionnaires or observations m\A to 
gather data about their perceptions about the school aml/o»> 
clasorocm. . 



School Snvi2iI2Bj&B^^ 



An <*4<ample of a method for assessing a total envirom<*nt in 
th-^a Stwrl^nt Qpinior. Poll as reported in >Ja<'^'^«<»-^i'Q i^JaJ^^^ . 
OX(?.^sroom. the gtujeut Oi^ consists of a forty^^^ . 

ilteift <3iue3tionnaire which provides the pupil with an opportitnitisr 
to indicate his opinion on many aspects of his school life* 
included ar« how the student feels about parent influence upon 
tha school, teacher ability » principal involvement, curricu5.urai 
tmp relationships,' student con^petition, school'- spirits . grades & 
hc»me»wrk, and /ftany' others..' , .:'.■[. '■ 



«J i^jti interesting treatise os\ which easier to chang^i jkms 
imimnUiX maontl^ by Bta:lon.i, A. "Human Bein|$8 Are i^ot 
kay M Ohum-iinm^ All," Si/iturdsiy .)?.«aview.j June 36,.'1S72. 

j*^p,' {^5*.t».7, '■ • 



• foXXow.ing Hem i;iXu«tmte the type of qu^etionas 

Xte* If Thi(r3 eohooX li»tona to pa3?«int'a opinicms 
a* too much 

ju«t enough 
c# too Jlittl© 

Item 2« The amount of "achooX spi3J»it" at this 
©chool is J i 
a* more than enough 

b. about right 

c. not enough 

3;te»» 3. When students need special attention*, 
toachers in this school ax>e: 
a 4 always ready to help 
b. generally ready to help 
o, ready to help if given special notice 

d. ready to help only in extreme cases 

Item k', In s©ner«il> my feelings toward school 
a* vei^y favorable— •! like it as it is 
b« 6omev;hat favorable-"-! would like a 

few changes 
c# somewhat unfavorable**-! would like 

many changes 
d. vory unfavorable-" I fre<iuontly feel 

tlmt school is pretty much of a waste 

of time 

Atiothtftr e'Aim^lcj of analyzing the school environment for 
than purpose of doiveloping a more responsive atmosphere is the 
Blemf3ntf.ii^y Schoo l J^y irofflnsnt Survey, reported in the National 
l!l<sfamv*:ary Principal » April » 1970 » by Sinclair. 

/UnclaiTf identified five major variables! practicality* 
'3a!^?'r'»"'*'^-.yt «.'t"arcn^ss,' propriety » and eeholarshipo Using these' 
W'iables as hi^ fram«swork» he ^Ss'veloped a forty item Questionnaire*^ 
ui wliich »»tudonts indicate ^ true response when the it^'r«fleot» 
t<?hat usually ocoitrs *inid a false s^es^onse when it Usually .d6esf mt. 
0{scitir« h tm t^ o'n^ »><».tio' ag^c^eins that, an item does ouoii*?' mg^ 
^^5fet« th.Ti; ''^A'l^a -K'^^m'pm ra.ttet a i»haraoteristii»'"of the^ stud«nt»0 



Some aamp3.os &x»0 4 

Item 8. r,tuc?.ent8 Know they shouXd check with tlm 

teacher before they do sorae thing that 

might break a school rulev 
Item X2. Students that the principal and teachers 

know will have it easier in this school, 
Item 21. This school seems to be an unfriendly place. 
Item 27. Sxi this school it is important to bo just 

like everyone else. 
Item 3H. Most of the teachers are very hard workers 

and they think the students should study 

hard too. 

Bex A contains a comparison of two schools on the Envir..>n" 



went Survey. 



Box A 



COMPARISON OF TWO SCHOOLS ON THE ELEMENTARY 
SCHOOL ENVIRONMENT SURVEY 
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The graphical summaries of Beta School mwU suggest that 
thQre isxiat a high ejuphasls on ovdov (practicality), a gr^atejc 
feeling of ccimaracleji'ie , frienaiinefss (community), and^4nvolve« 
jaent in experiences which develop a greater awareness of what 
is happening in the total society aa well as self awareness 
(awareness?). Alpha School would have fewer characteristics 
which would support to any degree the areas of practicality or 
cojnmunity. However, Alpha School would place more emphasfis on 
proper behavior arid conformity (propriety) and academic performance 
(scholarship) than Beta School, 

A most recent and comprehensive effort for providing moans 
of assessing students* attitudes about their school has been 
developed by Instructional Objectives Exchange at UCLA, a handy 
paperback titled: Attitude, T oward School, Grades K-^U provides 
some very interesting and varied methods for acquiring informa- 
tion about pupils' feelijigs towards many aspects of their 
school day. 

It is possible by using any of these environmental assess- 
weat devices to ascertain the students* viewpoint of what they 
f?ee in their day to day experiences in school. This is the type 
of feedback data that a principal or counselor along with a 
representative group of faculty and students could use as input 
.information in developing a school environment that is more ttined 
in with its student body as to ♦♦what is*' and ♦•what ought** to be 
<:i<i5VC)loped. , • 
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C jossyoom Environments 

When one desires iriiormftilon about th^ cXassroom «nv3.ron'« 
rmntt it is possible to g<iin information through two approaches* 
First, a questionnaire approach similar to what has already been 
indicated as one approach that can be used in the classroom. In 
addition, however, because it is possible to observe directly 
what verbal interaction is taking place, an interaction analysis 
approach can be used. That is, interaction analysis devices can 
be utilised to collect data as to what is happening when it is 
occurring rather than relying on the reflective thoughts of the 
students ex post facto* 

The questionnaire approach enables the teacher and /or 
counselor to gather data about a variety of dimensions which 
influence pupil responses. Another advantage to the use of 
questionnaires is that it enables students to express opinions 
which they may not feed <»mfortable in expressing publicly. 

A conceptual framework for helping school personnel develop 
questions wh3.ch can be answered through classroom solicitation 
is provided in PMlMSLSojAd^ by 
Schmuok et al. A companion volume, piagnosing Classroom Learning 
EiaJ^oBSa^^ ^'o^ et al*, provides a variety of devices which 

can be used to acquire information about the learning climate, 
eocial relations, pupil normfj, outside influences, parental 
influences, and pupil self concept. This publication also 
pvoviM helpful hints on interpreting the information generat0.d 
by tho asttes?sme.t?t devices. 



Th« eecona appr»oach to viewing the wox^ld oi: living in the 
eXa»si?oom is through interaction ^naXyeis. In othex> words * 
deciding in advance what it U one wishes to look at and then 
ISoing into the classroom to get a reading on these predetermined 
vaT»iables, Obviously this approach involves more than the class- 
room teacher. A second person, counselor, principal, subject 
area consultant, teacher aide can act as an objective observer 
and record the verbal and behavioral interaction as it transj. ires 
and can serve as an extra set of eyes to the classroom teacher. 

Basically there arc two constructs which may be followed in 
recording verbal interaction in a classroom. First j is the "sign" 
construct and the second is the "category** construct. The "sign" 
system consists of a fixed number of descriptive items which are 
not mutually exclusive. That is, each and every live observa- 
tion may not be included on the list of items to b© observed nor 
may each item be present during the observation period. Opera- 
tionally, the observer has a. predetermined list of items which 
after a specified block of time (usually two to ten minutes )j he 
will check the items that occurred during that period. After 
marking the appropriate items, the observer focuses on the 
group again and repeats the recording of items for each observa- 
tion period. Overall time lapse may be 20«3d minutes. 

The "category" construct is comprised of a fixed numbex? of 
mutually eseclueive categories to which each observation must be 
assigned. When an observer uses a category system, he observes s 
determines which category best represents what is occtirring and 
recordiis it inimediate3.y. This process is repeated throughout the 
obs«iirvation period <30-H0 minutes) and usually an observation is 



reco]C»d^<a eve)?y 3 to 10 aeconds. WIt«n the recording period i« 
concluded , the ohi?.^i>v<^\o has a aeqi^ential. series of observations 
^hich occurred during a given period of time* 

By far the most researched category system is the FXander*s 
Systm. This system consists of IQ categories, 7 assigned to 
teacher talk, 2 assigned to student talk, and a single category 
reserved for silence and/or confusion. This system permits gen- 
evatiag some hypothesis about the direct and indirect teacher 
styles. Numerous studies have been conducted utilizing Flanders' 
«yatem which have attempted to correlate the directness or 
indirectness of a teacher's verbal interaction and to correlate 
the teacher's verbal interaction find numerous other variables, 
such as academic achievement, attitude toward learning in school, 
etc. It is probably one of the most widely used systems that has 
been developed and includes a rather sophisticated method of 
interpreting the data recorded by the system* A more detailed 
development of the system and its uses are reported in the booklet ' 
by Amidon and Flanders, The Sole of the Teacher in the Classroom. 

To illustrate the proliferation of category systems, Simo« 
and Boyer have inventoried and reported 79 distinct systems. 
These observation systems focus on the affective, cognitive, 
psycho-motor, physical activity, sociological . structure and 
physical environiaent. Again, systems tend to reflect the purpose 
of the resea>?ch and can be adapted to specific individua|v||itua« 
tiono. The advantage of usi^g a well-tested Flanders type system 
io th'Xii there are normative data available against which comparisonB 
aan be made* For mmpU^ tho 2/3 ratio which suggests that 2/3»s 



of the time there is someone talking in the classroom and 2/3»s 
o.f the time It is the teacher. These norms are haeed on literally 
thousands of hours of observation o** te&chers in a variety of 
clascroom settings. Also, interestingly much of research being 
reported suggests that the indirect teacher is more effective 
in developing higher achievement and improved attitude towards 
echool. 

Individual Behavior 

The third level of the assessment process is focusing in 
on specific individual pupil behavior. After sufficient 
re*?.dings have been made about the larger environment it seems 
inevitable that there is a need tb examine behaviors of certain 
children. Again, the reason for the progression f??om total school 
environment to classroom to the individual is to suggest that 
laany of the problems observable in individuals can be reduced 
by attending to certain overall environmental changes. Vet, 
it iftust be recognized that certain problems are more persistent 
and l<sss amenable to change by environmental manipulations* 2t. 
is then necessary to identify specific assessment devices which 
Mill enable us to better understand the natu?re of the student 
md/oyy teacher problem and attempt to intervene with appropriate 
tactions* . 

The most common approach and usually the beginning point 
itt collecting base' rate or base line data. This becomes a 
reference point from which some judgment can be made as to tM 
oeriousness of the problem and -no serve as a basis for comparing 



pi?ogi»es8 over a period of time. IThis process is sometimes 
called a time-series «tudy in that the child ♦sto«3havior is 
not compared to any norm but to different samples of behavior 
observed during specific periods of timc# 

Operationally, base rate data collecting is initiated by 
the teacher describing the behavior she wishes modified. For 
example » a teacher may be very concerned over the disruptive 
behavior of a boy during reading class. The observer sets 
up a specific time block in which he will record the number 
of incidents of disruptive behavior, e.g. grunts, groans, 
hangings, etc. 

The base rate data collecting .can be varied and modified 
greatly to fit individual situations. The base rate data can 
consist of academic response rates, error rates, accuracy 
rates, disruptive behavior rates, study behavior rates, or 
various aspects of the teacher's behavior. 

Box B contains an illustration of an actual case. 



TIME- SERIES OBSERVATIONS OF THiB STUDY 
BEHAVIOR OF AN ELEMENTARY SCHOOL BOY 
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Thfe vertical axis is the percent of time spent studying 
during the observation pex-^iod. The horizontal axis is the 
number of days during which observations were made. The base- 
line observations were made while typical conditions in the 
classroom existed. The reinforcement periods consisted of the 
tsacher attending to the boy at times when he was engaged in 
study. The reversal period was the period of time when the 
teacher returned to the conditions prevailing during the base- . 
line period. As the data indicates*, study behavior improved 
jMrJcedly during periods when the teacher changed her manner of 
responding to the ohild. <flall» et al "Effects of Teacher 
Attention on Study Behavior" Journal of Applied Behavior Analysis 
vol. 1* Spring J 1968 6 pp* 1««15!.) 

Another a^ather widely used assessment devioe in: attempting 
to understand specific children is the us« of sociometrio devices* 
Thesfi devices attempt to determine who are the most or least 



popular youngsters in a class as viewed by their cXassmates* 
The important distinotion to he Kept in mind is to differentiate 
between the persons a ohiXd may prefer to play with from the 
persons the ahiXd may prefer to work with* Some research sug* 
gests that the youngsters selected by peers has a relationship 
to the situation in which they will relate. A child may prefer 
one youngst«»r for working with him on a mural while at recess he 
will pick another to play football. Obviously, different talents 
are needed in each situation and a child is somewhat pragmatic 
in his selections. 

It is possible to identify an infinite number and variety 
of individual assessiiient devices ranging from standardized 
personality tests to group achievement tests. jEach of these 
is appropriate as the conditions determine their need. Often 
times an outside specialist is needed in special cases which go 
beyond the expertise of the classroom teacher and/or counselor. 

In addition, these assessment devices can overlap one 
another and permit gathering data about both the student *s 
environment as well as gathering some information about a spec- 
ific etudent. Most of the questionnaires suggested in Diagnosina 
Classropm JLearnini; , En vironment urge the use of a student number 
system, which will permit recognition of Individual situations 
that may call for individual attention. 

thus far the emphasis has been on specific assessment tools,* 
this is not to imply that good common sense and inforiwal obser*» 
vations are not important. An al«rt, sensitive teaoh'ir can 
learn much from her students and can apply these ideas effectively 
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without rauch t'antoe. We know intuition op^^i^ateaj it is part ana 
pa3f»o«rX of any assessment procsea?>» but often m are dubious of 
its peliabiXity* The point is that there are times when more 
specific data is needed in order to get a saore accurate reading 
on what is transpiring in a particular situation* It ia when 
such a situation arises that the assessment devices presented 
are most appropriate and wiXl provide insights which might be 
missed by a more informal appraisal. However, there is still 
no substitute for an open, frank, and honfest discussion with 
students and attempting to implement their practical suggestions. 

Hopefully, the assessment tools provided will offer praotigal 
help to the teacher, counselor, and principal.. For it is blatantl. 
clear that our pupils are demanding to be recognized as persons 
and we are in need of developing means of better understanding 
the reasons behind the behavior we observe. The materials pres- 
ented here can give some direction to this search. 
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